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An  optimal  control  strategy  based  on  Pontryagin’s  Minimum  Principle  (PMP)  is  a  promising  solution 
because  it  provides  a  simple  solution  for  controlling  Hybrid  Electric  Vehicles  (HEVs)  and  guarantees  the 
best  performance  under  reasonable  conditions  [1,2].  However,  it  needs  to  be  very  careful  when  applying 
the  control  strategy  if  inequality  state  constraints  are  active  because  handling  the  state  constraints  is  one 
of  the  difficult  issues  in  optimal  control  problems.  In  contrast  to  HEVs,  Plug-in  Hybrid  Electric  Vehicles 
(PHEVs)  possibly  consume  all  of  the  available  electric  energy,  and  so  the  activation  of  the  state  constraint 
on  minimum  State  of  Charge  (SOC)  is,  unfortunately,  a  very  common  control  problem  for  PHEVs.  This 
paper  describes  mathematical  derivations  for  an  additional  condition  necessary  for  the  inequality  state 
constraints  and  solves  the  problem  with  several  control  options.  Whereas  PMP-based  control  allows  a 
unique  solution  for  HEVs  [2],  this  paper  shows  that  the  control  idea  based  on  PMP  produces  a  number  of 
alternative  solutions  for  PHEVs.  However,  battery  efficiencies  can  be  considered  to  evaluate  the  optimality 
of  each  solution,  and  simulation  results  from  several  control  options  show  that  maximizing  a  blended- 
mode  control  is  the  best  solution  to  saving  fuel  for  PHEVs.  In  terms  of  performance,  the  results  of  applying 
blended-mode  control  are  very  close  to  those  obtained  by  applying  a  global  optimal  solution  obtained 
from  Dynamic  Programming  (DP). 

Published  by  Elsevier  B.V. 


1.  Introduction 

Energy  management  in  Hybrid  Electric  Vehicles  (HEVs)  is  a  very 
interesting  subject  in  that  system  efficiency  could  be  improved  by 
changing  a  control  algorithm  in  the  Hybrid  Control  Unit  (HCU). 
This  improvement  could  be  achieved  without  additional  costs, 
or  sometimes,  affords  the  opportunity  to  cut  costs  by  optimizing 
the  size  of  the  components  that  have  unnecessarily  high  capacity. 
For  the  last  decade,  a  number  of  energy  management  strategies 
that  aim  to  control  the  system  in  optimality  have  been  vigor¬ 
ously  researched,  and  several  comparative  studies  classified  the 
strategies  according  to  algorithms,  such  as  rule-based  control,  arti¬ 
ficial  intelligence  control,  and  control  based  on  optimal  control 
theory  [3-6].  One  of  the  ideas  based  on  optimal  control  theory,  a 
control  concept  based  on  Pontryagin’s  Minimum  Principle  (PMP), 
was  introduced  as  a  supervisory  control  algorithm,  and  the  Equiv¬ 
alent  Consumption  Minimization  Strategy  [7]  has  been  interpreted 
in  the  concept  of  PMP  [1,8,9].  On  the  other  hand,  a  study  has  proved 
that  PMP-based  control  guarantees  global  optimality  under  real¬ 
istic  conditions  [2].  Furthermore,  several  researchers  have  shown 
that  the  control  concept  based  on  PMP  is  potentially  promising 
[10-13].  As  another  control  idea  based  on  optimal  control  the¬ 
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ory,  Dynamic  Programming  (DP)  is  an  outstanding  method  when 
solving  the  optimal  control  problem  because  it  always  produces  an 
unbeatable  solution,  but  it  is  not  easy  to  directly  apply  the  concept 
to  real-time  control.  On  the  other  hand,  PMP  is  very  easily  applied 
to  the  Real  World,  but  the  optimality  should  be  carefully  verified 
because  PMP  does  not  automatically  guarantee  the  optimality— it 
only  provides  necessary  conditions  for  an  optimal  solution.  There 
are  several  studies  that  proved  the  optimality  of  PMP-based  con¬ 
trol  in  HEVs  [1,2],  but  the  application  of  the  control  idea  needs 
additional  consideration  if  it  is  applied  to  Plug-in  Hybrid  Electri¬ 
cal  Vehicles  (PHEVs).  This  paper  primarily  describes  the  theoretical 
application  when  the  control  idea  is  applied  to  PHEV  because  a 
solution  from  PMP  shows  a  different  pattern  if  the  state  of  the  con¬ 
trol  problem  is  constrained  by  conditions  of  inequality.  Handling 
inequality  constraints  in  PMP  is  very  complicated  because  the  con¬ 
straints  possibly  produce  ambiguity,  which  is,  frequently,  called  a 
jump  condition  [14].  In  this  paper,  the  additional  jump  condition 
for  PHEVs  is  derived  from  mathematical  idea,  by  which  the  con¬ 
dition  can  be  explained  by  physical  meaning  because  the  co-state 
of  PMP  is  interpreted  as  an  equivalent  weighting  factor  between 
fuel  usage  and  electrical  usage.  In  general,  there  exist  two  feasible 
control  ideas  for  PHEVs.  One  idea  is  consuming  allowable  or  usable 
electrical  energy  as  soon  as  possible  and  sustaining  State  of  Charge 
(SOC)  on  the  depleted  level.  The  other  idea  is  using  a  blended  mode 
as  much  as  possible,  so  that  the  system  finally  consumes  all  of  the 
usable  electrical  energy  at  the  end  of  the  trip.  These  ideas  are  not 
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new  concepts,  but  both  of  them  can  be  realized  by  PMP-based  con¬ 
trol  with  the  jump  condition,  and,  substantially,  they  are  optimized 
by  the  concept,  so  their  maximum  performance  can  be  evaluated. 
Simulations  for  PHEVs  based  on  these  control  ideas  show  that  the 
system  truly  achieves  optimality  under  the  second  control  option 
in  the  maximized  blended  mode.  We  believe  that  this  paper  con¬ 
tributes  modestly  to  an  understanding  of  the  optimal  control  idea 
for  PHEVs,  and  so  researchers  will  be  able  to  use  the  information  in 
this  paper  to  create  strong  solutions  that  could  be  feasible  energy 
management  strategies  for  PHEVs. 

2.  Control  with  state  constraints 


Optimal  control  based  on  PMP  can  be  considered  to  be  a  promis¬ 
ing  solution  not  only  for  HEVs  but  also  for  PHEVs.  In  reality,  an  exact 
solution  of  the  control  concept  guarantees  global  optimality  when 
the  efficiency  of  the  battery  has  a  concave  curve  for  SOC  if  there 
is  not  a  state  constraint  [2].  It  is,  however,  not  easy  to  solve  the 
control  problem  if  the  state  constraints  exist,  such  as  a  limitation 
of  SOC  range,  and  applying  the  control  concept  at  the  state  con¬ 
straints  should  be  carefully  dealt  with  an  exact  solution.  In  this 
section,  necessary  conditions  associated  with  PMP  with  inequal¬ 
ity  state  constraints  are  introduced  to  address  the  control  issue  on 
constrained  boundaries. 


2.1.  Necessary  conditions 


As  a  clever  interpretation  of  the  Euler-Lagrange  equation  in  Cal¬ 
culus  of  Variation,  PMP  produces  necessary  conditions  that  optimal 
solutions  should  satisfy.  When  the  control  looks  for  the  minimum 
of  a  functional,  g, 

min  J  =  j g(x,  u,  t)dt  (1) 

over  pairs  (x,  u)  that  satisfy  X  =  /(x,  u),  the  Hamiltonian  of  this  prob¬ 
lem  is  defined  as: 


H  =  g(x,  u,  t)  +  A  /(x,  u) 


(2) 


where  X  is  Lagrange  multiplier,  which  is  frequently  called  as  a  co¬ 
state  in  optimal  control  problems.  When  the  final  time  and  the 
final  state  are  fixed,  the  principle  requires  that  the  optimal  solution 
satisfies  the  following  conditions  [1  ]: 


x  = 


m 

dx 


,  dH 


(3) 

(4) 


Further,  the  Hamiltonian  on  the  optimal  pair  (x*,  u*)  should  sat¬ 
isfy  that 


H(x*,  u*,X*,t)  <  H(x*,  u,  X*,  t) 


(5) 


The  input  u,  if  there  are  constraints  for  u,  should  be  admissi¬ 
ble  input  for  given  x  and  t,  and  x*(t)  satisfies  boundary  conditions 
at  initial  and  final  states.  Simply,  Eq.  (3)  always  resulted  in  the 
state  equation  ofX  =/(x,  u),  and  Eq.  (5)  is,  intuitively,  a  quite  nat¬ 
ural  condition  to  obtain  an  extreme  solution— that  is,  the  means  by 
which  the  optimality  cannot  be  achieved  with  u  inferior  to  other 
admissible  u.  The  only  intuitively  incomprehensible  condition  in 
Eq.  (4),  in  fact,  came  from  the  state  equation.  In  optimization  prob¬ 
lems,  the  multipliers  are  utilized  for  compensating  the  penalty  of 
the  constraint  function  and  are  determined  by  the  relative  geome¬ 
tries  between  the  objective  functions  and  the  constraint  functions. 
Because  the  functions  generally  do  not  depend  on  each  other,  inde¬ 
pendent  multipliers  are  supposed  to  be  for  each  constraint  function. 
As  a  special  case  of  the  optimization  problem,  the  optimal  control 


Fig.  1.  An  inequality  state  constraint,  h(x,t )  >  0,  returns  the  state  into  the  feasible 
area. 

problem  could  also  produce  an  arbitrary  multiplier  set,  A,  in  each 
constraint  /  in  every  moment,  but  the  multiplier  can  be  charac¬ 
terized  by  another  state  equation,  like  Eq.  (4),  because  the  state 
equation,  X  =/(x,  u),  gives  additional  information  for  /  according 
to  time,  which  is  a  very  unique  factor  that  categorizes  the  optimal 
control  problems  under  the  general  optimization  problems.  On  the 
other  hand,  an  important  note  to  this  optimal  principle  is  that  it 
does  not  fulfill  a  sufficient  condition  for  the  optimality.  If  a  solution 
satisfies  these  necessary  conditions,  it  is  just  a  candidate  for  an 
absolute  solution.  It  is,  however,  proved  that  the  necessary  condi¬ 
tion  can  be  sufficient  to  solve  the  optimal  control  problem  of  HEVs 
when  the  SOC  limitations  are  not  considered  [1],  and,  further,  the 
optimality  is  also  available,  even  when  using  a  wide  range  of  SOC, 
if  battery  efficiency  is  a  concave  function  of  SOC  [2].  In  this  paper, 
our  discussions  are  based  on  the  global  optimality  of  those  studies, 
and  the  optimality  will  be  considered  when  the  SOC  limitation  is 
applied  for  PHEVs. 

2.2.  Inequality  state  constraints 

As  stated  in  the  beginning  of  Section  2,  if  an  inequality  state 
constraint  in  Eq.  (6)  exists  as  shown  in  Fig.  1,  the  optimal  con¬ 
trol  problem  becomes  more  complicated  than  the  problem  without 
constraints  for  the  state  x. 

h{x,  t)  >  0  (6) 

In  this  case,  an  optimal  co-state  X *  that  satisfies  the  necessary 
condition  in  Eq.  (4)  might  be  discontinuous— the  discontinuity  is 
not  a  violation  of  Eq.  (4),  but  co-states  without  the  constraint  are 
generally  continuous.  For  last  several  decades,  a  number  of  meth¬ 
ods  have  been  introduced  to  solve  optimal  control  problems  with 
inequality  state  constraints,  which  are,  of  course,  very  effective  on 
various  types  of  constrained  states,  but  they  are  not  causal  or  are, 
sometimes,  ambiguous.  Hartl  et  al.  researched  a  number  of  method¬ 
ologies  and  categorized  them  by  several  groups  [14].  Although 
there  are  many  methods,  using  a  concept  of  a  jump  for  the  discon¬ 
tinuity  of  the  co-state  is  a  very  useful  idea  to  describe  the  solution 
of  the  inequality  state  constrained  problems,  so  an  additional  con¬ 
dition  that  describes  the  jump  will  be  briefly  introduced,  and  the 
application  of  the  control  idea  will  be  discussed  in  the  following 
section.  Before  the  discussion,  it  should  be  noted  that  there  were 
two  studies  that  solved  the  control  problem  of  PHEVs  by  applying 
alternative  methods.  One  study  [11]  used  an  additional  multiplier 
with  a  direct  adjoining  approach  [14],  which  is  substantially  based 
on  Karush  Kuhn  Tucker  condition,  and  the  other  one  [1]  utilized 
McGill’s  approach,  which  is  based  on  the  numerical  penalty  con¬ 
cept  [15].  These  are  very  effective  approaches  to  find  out  optimal 
solutions,  but  the  former  solution  is  not  easy  to  be  designed  as 
a  forward  looking  controller,  and  the  later  solution  includes  an 
ambiguity  because  the  penalty  concept  is  not  realistic.  Therefore, 
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a  comprehensive  approach  based  on  jump  condition  is  very  useful 
for  the  practical  control  problem  of  PHEVs. 


2.3.  Jump  conditions 


As  stated  in  Section  2.1 ,  the  co-state  X  is  characterized  by  the  co¬ 
state  equation  in  the  optimal  control  problem  in  Eq.  (4),  whereas 
Lagrange  multiplier  X  is  determined  by  the  geometric  relation 
between  the  objective  functions  and  the  constraint  functions  in 
general  optimization  problems.  However,  the  arbitrary  characteris¬ 
tic  may  appear  when  the  inequality  state  constraint  is  active,  which 
is  called  a  jump  condition.  The  mathematical  condition  for  the  idea 
of  the  jump  will  be  derived  in  this  section.  Considering  the  state 
constraint,  the  functional  yin  Eq.  (1)  can  be  expressed  as  [16]: 


J  = 


t)  +  k{f-x)}dt 


(7) 


where  t0  and  tf  are  an  initial  time  and  a  final  time.  The  objective  of 
the  control  is  to  find  out  an  extreme  trajectory  that  minimizes  the 
functional  in  Eq.  (1)  or  Eq.  (7)  while  satisfying  all  of  the  boundary 
conditions,  for  which  the  variation  of  J  should  be  zero 


8J  =  0 


(8) 


The  variation  8J  can  be  obtained  according  to  8x ,  8u,  and  8X, 
which  can  be  expressed  as  [17]: 


8J  =  Xq8xq  —  Xf8xf  —  Ho8to  +  Hf8tf  + 


8X 


+ 


dt  =  0 


(9) 


where  H  is  defined  as  the  Hamiltonian  in  Eq.  (2).  The  boundary  val¬ 
ues,  x0,  X0,  and  H0,  are  respectively  initial  values  for  each  variable, 
and  Xf,  Xf,  and  Hf  are  final  values  for  them.  In  the  general  control 
problem,  the  initial  time  and  the  initial  state,  t0  and  x0,  are  fixed 
because  they  are  possibly  given,  so  the  variations  for  these  two 
variables  are  zero,  8t0  =  8x0  =  0.  Therefore,  Eq.  (9)  is  to  be: 


8J  =  -kfSxf  +  Hf8tf  + 


I!  [KKKh 


dt  =  0 


(10) 


Considering  that  8X,  8x ,  and  8u  are  arbitrary  values,  all  of  the 
terms  in  Eq.  ( 1 0)  need  to  be  zero  to  satisfy  8J = 0.  If  Xf  and  tf  are  fixed, 
the  first  and  second  terms  in  Eq.  (10)  also  become  zero  because  8Xf 
and  8tf  are  zero,  which  allows  the  optimal  trajectory  to  have  any 
values  for  Xf  and  Hf.  Further,  by  setting  the  destinies  to  zero,  the 
three  terms  in  the  integral  result  in  the  three  necessary  conditions 
in  Eqs.  (3)-(5).  In  PMP,  the  necessary  condition  requires  the  mini¬ 
mization  of  Hamiltonian  in  Eq.  (5)  instead  of  dH/du  =  0,  which  is  a 
more  generalized  condition  for  optimality.  On  the  other  hand,  we 
can  expand  the  idea  to  a  piecewise  optimal  control  and  consider  8J 
when  x  has  a  corner  at  tj,  as  shown  in  Fig.  2. 

Dividing  the  trajectory  by  two  different  segments,  [t0  tj]  and  [tj 
tf],  the  functional  J  can  be  expressed  as: 

J=  f  {g(x,u,t)  +  X(J -x)}dt  +  f  [g(x,u,t)  +  k(f-x)}dt 

J  t0  J  tj 

(11) 


The  extreme  condition  in  Eq.  (8),  8J = 0,  must  be  satisfied  though 
x*  has  an  unexpected  corner.  Eq.  (9)  can  be  applied  to  each  segment 


Fig.  2.  A  piecewise-smooth  trajectory.  An  optimal  x*  has  a  corner  at  tj  andX*  is  not 
continuous  at  tj.  [17]. 


of  the  functional  J  when  x0,  t0,  Xf,  and  tf  are  fixed.  8J  can  be  expressed 
as: 


8J  =  -( Xj-XpSxj  +  (Hr  -  Hj)Stj  +  j‘  jx  -  ™  J  8k 

/[{< 


f .  dH ) 

1  9  H  " 

Ki 

\Sx+dUSu 

f .  dH) 

Ki 

\Sx+dUSu_ 

dt+ 


dt= 0 


(12) 


where  Xj  and  Hr  are  the  values  at  left-hand  side  limit  of  the  junc¬ 
tion  time  tj,  and  Xf  and  Hf  are  the  values  at  right-hand  side  limit. 
From  the  external  terms  of  the  integral,  a  condition  at  the  corner, 
or  at  junction  time  tj,  is  obtained,  which  is  expressed  as: 

-{Xr  -  Xf  )8Xj  +  (Hr  -  Hf  )8tj  =  0  (13) 

As  well  as  Weierstrass-Erdmann  corner  condition  is  derived  for 
the  Euler-Lagrange  equation  [17],  a  corner  condition  for  PMP  can 
be  derived  as  Eq.  (13).  The  meaning  of  the  jump  condition  can  be 
described  by  Eq.  (13).  If  there  does  not  exist  any  constraint  bar¬ 
rier  for  x,  8xj  and  8tj  can  be  arbitrary  values,  so  -(Xr  -  Xf )  and 
(Hr  -  H+ )  must  be  zero;  there  is  no  jump  for  the  co-state  or  Hamil¬ 
tonian  when  there  is  no  barrier  for  the  state.  The  jump  condition, 
however,  appears  when  an  additional  condition  enforces  a  corre¬ 
lation  between  8Xj  and  8tj  (i.e.,  the  barrier  of  the  inequality  state 
constrains  force  x  to  stay  in  a  feasible  area,  like  that  shown  in  Fig.  3). 

The  virtual  displacement  8xj  is  not  an  arbitrary  value  any  more 
when  x  touches  the  state  constraint.  If  x  is  starting  to  move  along  the 
inequality  constraint,  the  constraint  equation  is  activated,  h(x,  t)  =  0, 


Fig.  3.  The  optimal  trajectory  x  hits  the  state  barrier  at  tj,  but  it  cannot  penetrate 
it  and  possibly  moves  according  to  the  barrier.  On  the  barrier,  8xj  and  8tj  are  not 
arbitrary  values  any  more.  The  corner  condition  is  also  available  when  x  just  touches 
it  and  is  rebounded. 
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and  the  variation  of  h  should  be  zero  until  the  state  leaves  the 
constraint,  which  can  be  expressed  as: 

5h  =  i5*+t5t=°  (14) 

From  Eqs.  (13)  and  (14),  a  new  necessary  condition  at  tj  is 
obtained  when  the  inequality  constraint  is  activated: 


Sxj  _  Hj  -  H+  _  dhj/dt 
8tj  ~  Ar-At  ~  dhj/dx 

where  8tj  is  not  zero.  This  relation  is  stating  that 


V 


H+=HT 


3  h< 


(15) 


(16) 

(17) 


where  77  is  an  arbitrary  value  for  splitting  the  equation.  There  is 
an  additional  condition  that  characterizes  77— that  is,  77  is  always 
positive  in  our  condition,  but  it  could  be  different  in  other  studies 
because  the  condition  depends  on  the  signs  of  the  definitions  [14]. 
It  does  not,  however,  provide  important  information  to  determine 
77  forward  in  time.  On  the  other  hand,  this  jump  can  occur  in  every 
entry  in  which  x  hits  the  boundary,  or  it  can  occur  while  x  is  fol¬ 
lowing  the  boundary,  which  is  why  various  methodologies  exist  to 
characterize  A  and  77,  even  for  an  identical  x.  In  conclusion,  although 
Eqs.  (16)  and  (17)  do  not  directly  give  the  answer  for  designing  a 
controller  for  PEIEVs,  we  can  understand  the  jump  condition  that  A 
may  jump  to  a  different  value  when  x  touches  the  barrier  of  the  state 
constraint,  and  this  is  a  very  useful  and  practical  idea  for  solving  the 
optimal  control  problem  in  PEIEVs. 


3.  Optimal  control  for  PHEVs 

Beyond  the  mathematical  derivation  presented  in  the  previous 
section,  the  goal  of  this  study  is  to  design  a  practical  controller  for 
PEIEVs.  In  this  section,  the  application  of  PMP  for  PEIEVs  will  be 
introduced,  and  the  energy  management  issue  will  be  discussed 
on  the  basis  of  Charge  Depleting  (CD),  Charge  Sustaining  (CS),  and 
blended  modes. 


3.1.  PMP  on  PHEVs 

When  State  Of  Charge  of  the  battery,  SOC,  is  the  state  x,  and 
power  of  the  battery,  Pbat,  is  the  control  u ,  PMP-based  control  aims 
to  find  out  optimal  control  u  like  shown  in  Eq.  (5)  when  the  Hamil- 
tonian  can  be  expressed  as: 

H  =  mfc(Pbat,  t)  +  k  -/(SOC,  Pbat)  (18) 

where  rhfc  is  a  fuel  consumption  rate,  and /is  a  state  equation  for 
SOC  [1  ].  The  control,  Pbat,  is  constrained  by  the  system’s  limitations, 
such  as  motor  torque  limit,  regenerative  braking  limit,  or  battery 
power  limit.  Meanwhile,  the  state,  SOC,  is  generally  constrained  by 
the  limitation  of  SOC,  i.e., 

SOCmin  <  SOC  <  SOCmax  (19) 

where  SOCmin  and  SOCmax  are  minimum  and  maximum  limitations. 
In  the  control  problem  for  PEIEVs,  considering  that  SOCmin  is  a  con¬ 
stant,  the  barrier  of  the  constraint  in  Fig.  3  is  exactly  flat.  Therefore, 
8xj  should  be  zero  at  any  junction  time  tj  whereas  8tj  can  have  an 
arbitrary  value,  which  means  that  the  jump  occurs  only  for  A,  not 
for  H  [see  Eq.  (13)].  On  the  basis  of  the  concept,  a  practical  con¬ 
trol  solution  with  the  jump  condition  can  be  expected  as  shown  in 
Fig.  4. 

When  the  vehicle  is  starting  at  full  SOC  at  to,  an  initial  co-state, 
,  can  be  selected  for  a  Charge  Depleting  mode,  and  A  is  calculated 


Fig.  4.  Control  concept  for  k.  While  SOC  is  in  the  allowable  range  (>SOCmin),  A  is 
calculated  from  the  co-state  equation  according  to  initial  values,  and  it  jumps  to 
another  value  when  SOC  hits  the  constraint. 


from  the  co-state  equation  in  Eq.  (4)  for  the  depletion.  If  SOC  hits 
SOCmin,  A  jumps  to  A£s,  which  is  an  initial  value  for  a  Charge  Sus¬ 
taining  mode,  but  the  co-state  equation  in  Eq.  (4)  is  still  available  for 
A.  In  that  A  is  interpreted  as  a  weighting  factor  of  electrical  usage, 
the  jump  physically  means  a  change  in  the  overall  pattern  of  elec¬ 
trical  consumption  to  avoid  violating  the  constraint.  For  instance,  it 
informs  the  controller  that  the  electrical  energy  becomes  an  expen¬ 
sive  source  when  SOC  hits  the  minimum  limit.  Now,  an  intricate 
question  remains  in  this  control  concept— how  we  can  choose  A£s 
and  A£d?  In  terms  of  the  conclusion,  there  is  no  brilliant  method  to 
estimate  these  co-states,  but  alternative  ways  could  be  considered 
for  the  Real  World  application.  For  example,  if  A£d  is  selected  as  0, 
the  controller  tries  to  use  electricity  as  much  as  possible  because 
the  Hamiltonian  would  give  a  message  that  the  cost  of  the  electrical 
usage  is  very  low,  or  zero.  After  consuming  all  possible  electricity 
under  the  zero  co-state,  the  controller  can  choose  an  appropriate 
A£s  if  the  future  driving  cycle  is  given  [10],  or,  if  no  information  is 
given,  the  controller  can  regulate  the  Acs  to  sustain  SOC  [13],  both 
of  which  are  very  practical  solutions  and  showed  good  results  in 
simulations.  This  control  option  could  be  a  practical  solution,  but 
the  problem  is  that  the  solution  is  unfortunately  not  a  unique  one 
obtained  from  PMP-based  control.  Because  A  affects  the  pattern  of 
SOC,  selecting  different  A£d  at  the  starting  time  causes  a  different 
junction  time  /,  and  the  controller  should  choose  another  A£s  to 
sustain  SOC  at  the  depleted  level,  at  which  a  lot  of  solutions  that 
satisfy  the  jump  condition  could  exist.  PMP  does  not  state  which 
solution  is  the  best  one  because  all  of  these  solutions  satisfy  the 
necessary  conditions  from  PMP,  so  the  optimality  will  be  discussed 
on  the  basis  of  additional  information  in  the  following  section. 

3.2.  Blended-mode  control 

As  stated  in  the  previous  section,  applying  the  necessary  con¬ 
ditions  to  address  the  control  problems  of  PHEVs  does  not  result 
in  a  unique  solution,  so  several  strategies  to  realize  the  PMP-based 
control  with  the  jump  condition  could  be  considered  for  the  opti¬ 
mal  solution.  The  easiest  control  is  to  try  and  not  use  fuel  until  all 
of  the  usable  electrical  energy  is  depleted,  as  we  suggested  in  the 
previous  section.  In  that  case,  the  Charge  Depleting  (CD)  mode  is 
shortened  like  the  SOCa  shown  in  Fig.  5  because  the  controller  does 
not  allow  the  engine  to  be  turned  on  if  the  motors  can  produce  all  of 
the  requested  power  until  the  usable  electrical  energy  is  exhausted. 
After  the  CD  mode,  the  Charge  Sustaining  (CS)  mode  can  be  real¬ 
ized  by  an  appropriate  A£s.  One  of  the  alternatives,  SOCb  in  Fig.  5, 
uses  a  blended-mode  control  that  allows  the  engine  to  support  the 
propulsion  power  even  though  motors  are  capable  of  supplying  all 
of  the  requested  power.  To  realize  this  scenario,  a  well-estimated 
initial  A0  at  to  is  absolutely  necessary,  so  that  SOC  does  not  touch 
the  limit,  and  the  system  consumes  all  electrical  energy  at  tf,  as 
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Fig.  5.  SOCa  tries  to  use  pure-electric  mode  as  much  as  possible,  whereas  SOCb 
utilizes  the  blended  mode  until  the  end  of  the  driving  cycle. 
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Fig.  6.  The  simplified  configuration  of  the  power  split  hybrid  system  used  in  this 
study. 


shown  in  Fig.  5.  Both  of  SOCa  and  SOCb  should  be  considered  as 
optimal  solutions  that  satisfy  the  necessary  conditions  of  PMP.  The 
difference  between  the  two  is  that  SOCa  requires  a  jump  when  the 
system  turns  from  CD  mode  to  CS  mode,  but  SOCb  does  not  have 
the  discontinuous  X  because  the  constraint  has  not  been  activated. 
Because  both  of  these  control  options  fulfilled  the  optimality,  the 
performance  of  the  control  cannot  be  compared  by  PMP.  Instead, 
it  needs  to  consider  the  battery  efficiency  to  compare  these  two 
control  scenarios. 

If  the  battery  were  very  efficient  at  low  SOC  (like  SOCmin),  SOCa 
would  be  superior  to  SOCb  because  SOCa,  intuitively,  operate  in  the 
efficient  range  more  so  than  SOCb.  In  the  real  world,  however,  SOCa 
does  not  operate  in  the  efficient  range  because  battery  is  generally 
inefficient  near  SOCmin— that  is  one  reason  why  there  is  a  limitation 
of  minimum  SOC.  Under  a  realistic  battery  model,  a  previous  study 
showed  that  the  SOCb  is  a  global  and  unique  solution  when  there 
is  no  limitation  for  SOC  [2],  which  is  the  case  where  the  vehicle  is 
controlled  by  a  continuous  X  without  jump.  According  to  the  proof, 
there  is  no  alternative  solution  that  can  defeat  the  continuous  X  if 
the  efficiency  curve  is  concave  for  SOC,  and  if  the  efficiency  near 
SOCmin  is  lower  than  other  SOC.  By  expanding  this  idea,  a  conclu¬ 
sion  can  be  obtained  that  PMP-based  control  always  achieves  the 
better  performance  if  the  blended  mode  lasts  for  as  long  as  possible: 
SOCb  >  SOCc  >  SOCa.  In  that  the  blended  mode  has  more  opportuni¬ 
ties  to  control  the  power  management  than  all-electric  mode,  this 
conclusion  is  reasonable.  Flowever,  choosing  an  appropriate  initial 
Xq  at  to  for  the  all-blended  mode  is  not  convenient  when  the  driv¬ 
ing  schedule  is  not  given  prior,  and  so  a  practical  concept  for  the 
blended  mode  could  be  truly  realized  with  intelligent  devices  based 
on  a  Global  Positioning  System,  or  it  could  be  applied  to  vehicles 
driven  under  predictable  patterns,  like  buses  on  regular  routes  [12]. 

4.  Optimal  control  simulation 

Three  control  scenarios  are  used  in  this  study.  The  first  is  the 
control  that  maximizes  the  blended  mode,  which  produces  a  tra¬ 
jectory  of  SOC  like  SOCb  in  Fig.  5.  The  second  is  the  control  that 
uses  the  all-electric  mode— the  engine  produces  power  only  when 
the  motors  does  not  supply  all  the  requested  power— and  CS  mode, 
like  SOCa,  in  which  the  co-state  X  needs  to  jump  when  entering 
CS  mode.  The  third  is  a  solution  from  Dynamic  Programming  that 
produces  an  absolute  trajectory,  which  is  used  to  verify  the  optimal 
solution  from  PMP. 

4.1.  Simulation  and  vehicle  model 

The  vehicle  model  used  in  this  study  is  a  power  split  hybrid  sys¬ 
tem  that  has  a  single  planetary  gear  set  as  a  power  split  device, 
like  that  shown  in  Fig.  6.  All  of  the  data  for  the  component  models 
and  vehicle  model  are  based  on  a  2004  Toyota  Prius  in  Autonomie 
developed  by  Argonne  National  Laboratory  (see  Table  1 )  [  1 8].  Espe¬ 
cially,  the  battery  capacity  is  expanded  from  1.3  kWh  to  5.2  kWh 
to  realize  the  PHEV’s  performance  [19]. 


To  solve  the  optimal  control  problem,  OC_SIM,  which  was  devel¬ 
oped  by  Seoul  National  University,  is  used  for  each  control  option. 
The  simulator  is  designed  for  users  to  easily  define  the  vehicle’s 
configuration  and  to  select  the  components  from  its  database.  The 
simulator  is  able  to  produce  the  optimal  control  trajectory  solved 
from  both  PMP  and  DP  by  using  a  backward-looking  simulation. 
The  vehicle  model  is  evaluated  on  the  Urban  Dynamometer  Driving 
Schedule  (UDDS)  extended  to  5  times  the  cycle,  which  is  selected 
to  have  sufficient  distance  to  observe  the  differences  among  the 
control  options  when  different  initial  co-states  are  chosen.  This 
study  is  only  focusing  on  a  relative  comparison  of  the  optimal  con¬ 
trol  concepts,  whereas  selecting  a  representative  cycle  or  sizing  a 
battery  capacity  could  be  another  critical  issue  for  evaluating  the 
performance  of  PHEVs  [19]. 

4.2.  Simulation  results 

As  the  condition  of  PHEVs,  the  simulation  used  the  initial  SOC 
as  90%  and  allowed  the  system  to  consume  the  electrical  energy 
until  SOC  fell  to  20%.  By  selecting  multiple  initial  co-states,  different 
solutions  can  be  obtained  from  PMP  control.  Fig.  7  shows  three 
different  SOC  trajectories  solved  by  PMP  and  one  SOC  trajectory 
solved  by  DP. 

First,  the  trajectory  ‘PMP  jump  V  is  the  solution  when  is 
zero  at  starting  time.  In  that  case,  the  system  tries  to  consume  the 
electrical  energy  as  much  as  possible  until  SOC  hits  the  constraint, 
and,  when  SOC  does  hit  the  constraint,  the  co-state  jumps  to  an 
appropriate  A,£s,  so  SOC  is  sustained  until  the  time  horizon,  which 
is  the  case  of  SOCa  described  in  section  3.2.  ‘PMP  jump  2,’  is  another 
case  of  PMP  solution  in  which  the  initial  co-state  is  smaller  than 
the  value  of  ‘PMP  jump  1,’  which  is  able  to  extend  CD  mode  up  to 
about  5000  s  by  using  the  blended-mode  control,  but  it  still  needs 
the  jump  of  the  co-state  when  entering  to  CS  mode.  On  the  other 
hand,  the  SOC  trajectory  ‘PMP  exact’  is  obtained  by  selecting  an 
appropriate  A0,  so  that  the  system  uses  only  the  blended  mode  for 
the  entire  driving  cycle.  To  find  out  the  exact  A0  from  iterative  sim¬ 
ulations,  the  simulator  uses  multiple  shooting  methods  combined 
with  a  variation  of  extremals  [1  ].  The  trajectory  ‘DP’  is  introduced 
to  prove  that  ‘PMP  exact’  is  the  best  real  solution  of  the  three  PMP 
solutions. 

Table  1 

Vehicle  parameters  used  in  simulations. 

Vehicle  total  mass 
Engine 
Motorl 
Motor2 
Battery 

Planetary  gear  ratio 
Final  gear  ratio 
Rolling  resistance  coefficient 
Frontal  area 
Drag  coefficient 
Wheel  radius 
Air  density 


1490  kg 

1500  cc  (peak  power:  43  kW) 

25  kW  (peak  power:  50  kW) 

15  kW  (peak  power:  30  kW) 

5.2  kWh 
2.6(78/30) 

4.113 

0.007  +  0.00012  x  vehicle  velocity 

2.25  m2 

0.29 

0.305  m 

1 .23  kg  irr3 
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SOC  trajectories 


Fig.  7.  SOC  trajectories  when  jump  condition  is  applied.  ‘PMP  exact’  indicates  the 
optimal  solution  when  there  is  no  jump,  and  DP  solution  shows  that  ‘PMP  exact’  is 
the  optimal  solution. 


Time  (s) 

Fig.  8.  Trajectories  of  co-states  are  discontinuous  when  SOC  hits  the  constraint. 

Optimal  trajectories  of  co-states  for  the  three  solutions  are 
shown  in  Fig.  8,  in  which  the  co-states  for  ‘PMP  jump  V  and  ‘PMP 
jump  2’  jump  to  other  co-states  when  SOC  hits  20%,  and  A,£d  and 
\qS  for  the  trajectories  are  shown  in  Table  2.  On  the  other  hand, 
the  co-state  could  be  considered  to  be  a  near  constant  value  for 
the  control  problem  of  HEVs  [1,9],  and  the  co-states  shown  for  CS 
modes  in  Fig.  8  are  not  changed  much,  which  makes  the  controller 
simple  when  it  is  applied  to  the  real  vehicle.  However,  the  co-states 
in  CD  modes  show  relatively  greater  change  than  the  CS  modes,  so 
it  is  not  a  good  approach  to  use  a  constant  co-state  for  the  control 
ofPHEVs. 

The  objective  of  the  control  is  to  minimize  fuel  consumption, 
and  so  the  performance  of  the  control  is  evaluated  on  the  basis  of 
total  fuel  consumption,  as  shown  in  Fig.  9. 


Table  2 

Jump  conditions  of  each  solution. 


Initial  X  or  A.[jd 

Entry  time  (s) 

PMP  jump  1 

0 

-1160.53 

3874 

PMP  jump  2 

-1180 

-1158.87 

5011 

PMP  exact 

-1225.72 

- 

- 

Cumulative  Fuel  Consumption 


Fig.  9.  The  results  of  total  fuel  consumption  according  to  jump  conditions. 


As  we  discussed  in  Section  3.2,  the  solution  from  ‘PMP  exact’  that 
maximizes  the  blended  mode  achieves  the  best  performance  of  the 
three  PMP  solutions.  As  long  as  the  battery  has  higher  efficiency 
at  middle  range  of  SOC  than  at  low  range,  it  is  quite  natural  that 
the  optimal  solution  would  not  stay  at  low  SOC.  To  compare  the 
exact  performance  of  the  control  options,  corrected  fuel  consump¬ 
tions  are  calculated.  By  selecting  appropriate  initial  and  jumped 
co-states,  the  final  SOC  of  each  solution  is  very  close  to  the  desired 
final  value.  However,  it  is  not  possible  to  numerically  select  a  co¬ 
state  that  exactly  produces  a  desired  final  SOC,  and  so  the  corrected 
fuel  consumption  is  used  to  compare  the  performances  of  the  con¬ 
trol  options. 

For  example,  the  fuel  consumption  of  ‘PMP  exact’  is  539.55  g, 
while  the  final  SOC  is  1 9.94%,  which  is  not  the  desired  value  of  20%. 
The  fuel  consumption  is  shifted  to  equivalent  fuel  consumption  at 
20%  according  to  the  optimal  pattern  of  fuel  consumption  obtained 
from  DP,  as  shown  in  Fig.  10,  by  which  the  performance  can  be 
evaluated  at  the  equivalent  usage  of  electricity.  The  results  for  the 
three  PMP  solutions  are  shown  in  Table  3  with  the  corrected  values. 

If  the  controller  realizes  a  blended  mode  for  the  entire  driving 
cycle,  it  can  save  about  6%  in  fuel  consumption  compared  to  using 


Correction  of  Fuel  Consumption 


Fig.  10.  An  example  of  the  correction  for  exact  PMP  solution. 


10386 


N.  Kim  et  al.  /  Journal  of  Power  Sources  196  (201 1 )  10380-10386 


Table  3 

Total  fuel  consumption  of  each  control. 


Fuel  consumption  (g) 

SOCf  (%) 

Corrected  fuel  consumption  (g) 

Fuel  save (%) 

PMP  jump  1 

575.134 

20.0005 

575.128 

- 

PMP  jump  2 

553.858 

19.9726 

554.141 

+3.65 

PMP  exact 

539.550 

19.9359 

540.214 

+6.07 

DP 

538.710 

20.0000 

- 

+6.33 

Performance  according  to  initial  Co- state 


Fig.  11.  The  fuel  consumption  and  the  ratio  of  the  blended  mode  to  the  entire  driving 
cycle,  according  to  co-states. 


strains  the  SOC  of  PHEVs,  so  that  it  does  not  operate  lower  than  a 
certain  value,  such  as  SOC  >  SOCmin.  In  this  study,  the  control  prob¬ 
lem  of  PHEVs  is  described  by  focusing  on  the  jump  condition,  and  it 
shows  that  the  jumped  co-state  physically  means  the  change  of  the 
usage  pattern  of  electrical  energy  for  not  violating  the  constraints. 
Several  control  options  that  satisfy  the  necessary  conditions  of  PMP 
are  introduced  according  to  the  jump  condition.  On  the  basis  of  a 
backward  simulation  technique,  maximizing  the  blended  mode  is 
the  best  control  solution  to  minimize  fuel  consumption— optimal 
control  maximizes  the  blended  mode  and  results  in  fuel  savings  of 
up  to  6%  on  an  about  35  miles  urban  cycle,  compared  to  the  control 
option  that  consumes  the  available  electricity  as  soon  as  possible. 
Although  the  PMP-based  control  with  the  jump  condition  very  well 
explains  the  behavior  of  the  optimal  control  for  PHEVs,  applying  the 
control  concept  to  the  Real  World  is  another  problem  because  lots 
of  experience  is  essential  to  design  a  controller  that  approximates 
a  good  co-state.  However,  understanding  the  behavior  of  the  co¬ 
state  on  the  control  problem  is  an  important  step  in  applying  the 
control  concept  to  the  Real  World. 
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blended  mode  according  to  the  co-state  are  shown  in  Fig.  11. 

In  the  figure,  the  ratio  of  the  blended  mode  is  defined  as: 


Ratio  of  blended  mode  = 


Driving  time  of  a  blended  mode 
Driving  time  of  a  entire  trip 


(20) 
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